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ABSTRACT 



Apparatus for decoding an HDTV signal conveyed as 
high and low priority data in high and low priority 
channels respectively, wherein said high and low prior- 
ity data originated from blocks of hierarchically en- 
coded compressed video data, with data of greater im- 
portance for image reproduction from each block allo- 
cated to the high priority channel and the remaining 
data from each block allocated to the low priority chan- 
nel, includes circuitry for. identifying and segmenting 
high and low priority data for corresponding blocks and 
recombining the high and low priority data into an 
hierarchically encoded compressed video data stream. 

17 Claims, 12 Drawing Sheets 
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APPARATUS FOR RECOMBINING PRIORITIZED 
VIDEO DATA 

This invention relates to a system for processing a 5 
high definition television (HDTV) signal, and more 
particularly to apparatus for recombining transmitted 
compressed and encoded data which has been priorit- 
ized and conveyed in high and low priority channels. 

BACKGROUND OF THE INVENTION 10 

Digital high definition video data may be successfully 
transmitted over terrestrial television channels, as de- 
scribed herein, by partitioning the video data between 
high and low priority information, and quadrature am- 15 
plitude modulating the high and low priority data on 
separate carriers respectively. The modulated carriers 
are included in a 6 MHZ frequency spectrum and then 
the combined signal is translated to occupy a standard 
broadcast channel spectrum. The high priority data is 20 
transmitted with relatively high power and the low 
priority data with relatively low power. High priority 
data is that video data which is sufficient to reproduce 
an image, albeit of lesser quality than a high definition 
image. 25 

The present invention is directed to circuitry for 
recombining, at the receiver, compressed video data 
which has been prioritized between relatively high and 
low priority video data For purposes of this disclosure 
the video data will be presumed to be compressed in 30 
MPEG like format What is meant by "MPEG like" is 
a coding format similar to the standardized coding for- 
mat being established by the International Organization 
for Standardization. The standard is described in the 
document "International Organization for Standardiza- 35 
tion", ISO-IEC JT(1/SC2/WG1), Coding of Moving 
Pictures and Associated Audio, MPEG 90/176 Rev.2, 
Dec. 18, 1990, which document is incorporated herein 
by reference for description of the general code format. 

In the system described herein the video signal is 40 
compressed in such fashion to develop blocks of data 
codewords. The data in respective blocks are divided 
between high and low priority transmission channels 
according to the relative importance of the codewords 
for image reconstruction. The compressed data in the 45 
high and low priority channels include, at least in part, 
variable length encoded data without codeword demar- 
cation. 

At the receiver high and low priority data from cor- 
responding blocks is recombined for decompression 50 
purposes. The fact that the transmitted data codewords 
do not have defined boundaries complicates the recom- 
bination of high and low priority data. 

SUMMARY OF THE INVENTION 55 

The present invention relates to apparatus for receiv- 
ing prioritized data from two channels and combining 
the data from the two channels into a common data 
stream. The signal operated upon is conveyed as high 
and low priority data in high and low priority channels 60 
respectively, said high and low priority data being gen- 
erated from encoded compressed video data occurring 
as blocks of codewords in descending order of impor- 
tance for image reproduction, and wherein data 
through a jth codeword of respective blocks arc alio- 65 
cated as high priority data and the remaining code- 
words for respective blocks are allocated as low prior- 
ity data. The apparatus includes a first circuit means, 



212 

2 

responsive to conveyed high priority data, for identify- 
ing rspective blocks of high priority data; a second 
circuit means, responsive to conveyed low priority 
data, for identifying respective blocks of low priority 
data; and a third circuit means for appending respective 
blocks of codewords of low priority data to corre- 
sponding blocks of codeowords of high priority data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagrams of an HDTV en- 
coding/decoding system embodying the invention. 

FIGS. 1B-1C are pictorial representations of sequen- 
ces of field/frames of encoded video signal useful in 
describing the invention. 

FIG. 2 is a pictorial representation of a macroblock of 
data provided by the compression circuit of FIG. 3. 

FIG. 3 is a block diagram of a video signal compres- 
sion circuit. 

FIG. 3A is a generalized pictorial representation of 
the data format provided by the compression circuit of 
FIG. 3. 

. FIG. 4 is a block diagram of exemplary circuitry 
which may be utilized for the formatting circuit 111 of 
FIG. 3. 

FIG. 5 is a block diagram of exemplary circuitry 
which may be implemented for the Priority Select cir- 
cuitry of FIG. 1. 

FIG. 5A is a flow diagram illustrating the operation 
of the FIG. 5 analyzer. 

FIG. 6 is a diagram of the signal format provided by 
the transport processor 12 of FIG. 1. 

FIG. 7 is a block diagram of exemplary circuitry 
which may be implemented for the Transport Process 
circuit of FIG. 1. 

FIG. 8 is a block diagram of exemplary circuitry 
which may be implemented for the transport processor 
25 of FIG. 1. 

FIG. 9 is a block diagram of exemplary circuitry 
which may be implemented for the priority deselect 
circuit 26 of FIG. 1. 

FIG. 10 is a block diagram of exemplary circuitry 
which may be implemented for the decompression cir- 
cuit 27 of FIG. 1. 

FIG. 10A is a block diagram of a combination of an 
alternative priority deselect circuit and a decompres- 
sion circuit. 

FIG. 10B is a flow chart of the operation of the FIG. 
10A priority deselect circuit. 

FIG. 11 is a block diagram of exemplary circuitry 
which may be implemented for the MODEMS 17 and 
20 of FIG. 1. 

DETAILED DESCRIPTION 

An exemplary HDTV system which may be sup- 
ported by the present invention includes a two-to-one 
interlaced signal of 1050 lines at 59.94 frames per sec- 
ond. The nominal active picture has 960 lines of 1440 
pixels each with an aspect ratio of 16x9. The signal is 
transmitted using two 64 quadrature amplitude modu- 
lated (64-QAM) carriers, frequency multiplexed in a 6 
NMHz transmission band. The nominal total bit rate, 
including video, audio and auxiliary data, is 26-29 
Mbps- 

The video signal is initially compressed in confor- 
mance with an MPEG-like format, albeit using both 
fields of each frame and with higher pixel density. 
Thereafter the MPEG-type signal codewords are 
parsed into two bit streams in accordance with the 
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relative importance of the respective codeword types. lock address, a macroblock type and a quantization 

The two bit streams are independently processed to parameter. The coded coefficients are illustrated in 

apply error correction overhead bits, and then caused to layer L6. Note each macroblock is comprised of 6 

QAM respective carriers. The modulated carriers are blocks, including four luminance blocks, one U chromi- 

combined for transmission. The bit streams of relatively 5 nance block and one V chrominance block. See FIG. 2. 

greater and lesser importance are designated high prior- A block represents a matrix of pixels, e.g., 8x8 over 

ity (HP) and low priority (LP) channels respectively. which a discrete cosine transform (DCT) is performed. 

The high priority channel is transmitted with approxi- The four luminance blocks are a 2 X 2 matrix of contigu- 

mately twice the power as the lower priority channel. ous luminance blocks representing, e.g., a 16 x 16 pixel 

The high priority/low priority information ratio is ap- 10 matrix. The chrominance (U and V) blocks represent 

proximately one-to-four. The approximate net data the same total area as the four luminance blocks. That is 

rates after forward error correction are 4.5 Mbps HP the chrominance signal is subsampled by a factor of two 

and 18 Mbps LP. horizontally and vertically relative to luminance, before 

FIG. 1 illustrates an exemplary HDTV encoding/de- compression. A slice of data corresponds to data repre- 

coding system according to the invention. FIG. 1 shows 15 senting a rectangular portion of an image corresponding 

the system processing a single video input signal, but it to an area represented by a contigous group of macrob- 

is to be understood that the luminance and chrominance locks. 

components are compressed separately, and that the The block coefficients are provided one block at a 

luminance motion vectors are utilized for generating time with the DCT, DC coefficient occurring first fol- 

compressed chrominance components. The compressed 20 lowed by respective DCT AC coefficients in the order 

luminance and chrominance components are inter- of their relative importance. An end of block code EOB 

leaved to form macroblocks before codeword priority is appended at the end of each successively occurring 

parsing. block of data. 

A sequence of image field/frames as per FIG. IB is The amount of data provided by the compressor 10 is 

applied to circuitry 5 which reorders the field/frames 25 determined by the rate control element 18. As is well 

according to FIG. 1C. The reordered sequence is ap- known compressed video data occurs at variable rates, 

plied to a compressor 10 which generates a compressed and desirably, data is transmitted at a constant rate 

sequence of frames that are coded according to an equivalent to the channel capacity, to realize efficient 

MPEG-like format. This format is hierarchical and is use of the channel. Rate buffers 13 and 14 perform the 

illustrated in abbreviated form in FIG. 3A. 30 variable to constant data rate translation. It is also 

The MPEG hierarchical format includes a plurality known to adjust the amount of data provided by the 

of layers each with respective header information. compressor in accordance with the level of occupancy 

Nominally each header includes a start code, data re- of the buffers. Thus the buffers 13 and 14 include cir- 

lated to the respective layer and provision for adding cuitry to indicate their respective level of occupancy, 

header extensions. Much of the header information (as 35 These indications are applied to the rate controller 18 to 

indicated in the referenced MPEG document) is re- adjust the average data rate provided by the compressor 

quired for synchronization purposes in an MPEG sys- 10. The adjustment is typically accomplished by adjust - 

terns environment. For purposes of providing a com- ing the quantization applied to the DCT coefficients, 

pressed video signal for a digital HDTV simulcast sys- Quantization levels may be different for the different 

tern, only descriptive header information is required, 40 types of frame compression. Details of an exemplary 

that is start codes and optional extensions may be ex- method for determining quantization levels may be 

eluded. The respective layers of the coded video signal found in application Ser. No. 494,098, filed Mar. 15, 

are illustrated pictorially in FIG. 2. 1990 and entitled "Digital Signal Coding With Quanti- 

When referring to the MPEG-like signal produced by zation Level Computations,*' which application is in- 

the present system what is meant is that a) successive 45 eluded herein by reference; 

fields/frames of video signal are encoded according to Compressed video data hierarchically formated as 

an I, P, B coding sequence, and b) coded data at the indicated in FIG. 3A is coupled to a priority select 

picture level is encoded in MPEG-like slices or group element 11, which parses the coded data between a high 

of blocks albeit that the number of slices per field/frame priority channel HP and a low priority channel LP. 

may differ and the number of macro blocks per slice 50 High priority information is that information, the loss or 

may differ. corruption of which, would create the greatest degrada- 

The coded output signal of the present system is tion in reproduced images. Stated conversely, it is the 
segmented in groups of fields/frames (GOF) illustrated least data needed to create an image, albeit less than a 
by the row of boxes L2 (FIG. 3A). Each GOF (L2) perfect image. Low priority information is the remain- 
includes a header followed by segments of picture data. 55 ing information. The high priority information includes 
The GOF header includes data related to the horizontal substantially all of the header information included in 
and vertical picture size, the aspect ratio, the field/- the different hierarchical levels plus the DC coefficients 
frame rate, the bit rate, etc. of the respective blocks and a portion of the AC coeffi- 

The picture data (L3) corresponding to respective cients of the respective blocks (level 6, FIG. 3A). 

fields/frames includes a header followed by slice data 60 The ratio of HP and LP data at the transmitter is 

(LA). The picture header includes a field/frame number approximately 1:4. At the transport processor auxiliary 

and a picture code type. Each slice (L4) includes a data is added to the signal to be transmitted. This auxil- 

header followed by a plurality of blocks of data MBi. iary signal may include digital audio signal and, e.g., 

The slice header includes a group number and a quanti- teletext data. In this example at least the digital audio 

zation parameter. 65 will be included in the HP channel. The average 

Each block MBi (L5) represents a macroblock and amount of the auxiliary data included in the HP channel 

includes a header followed by motion vectors and is calculated and compared to the expected statistical 

coded coefficients. The MBi headers include a macrob- average of the compressed video information. From this 
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the ratio of high and low priority compressed video is applied to a decompressor 27. The decompressor 27 

information is calculated. The priority select element performs the inverse function of the compressor 27. 

parses the data provided by the compressor 10 accord- FIG. 3 illustrates an exemplary compressor apparatus 

ing to this ratio. which may be utilized for element 10 of FIG. 1, for 

The HP and LP compressed video data are coupled 5 providing hierarchically layered compressed video 
to a transport processor 12 which a) segments the HP data. The apparatus shown only includes the circuitry 
and LP data streams into transport blocks, b) performs required to generate compressed luminance data. Simi- 
a parity or cyclic redundancy check on each transport lax apparatus is required to generate compressed chro- 
block and appends the appropriate parity check bits minance U and V data. In FIG. 3 there are elements 104 
thereto, and c) multiplexes the auxiliary data with the 10 and 105 designated as elements for computing forward 
HP or LP video data. The parity check bits are utilized and backward motion vectors respectively. Since 
by the receiver for isolating errors in conjunction with whether a motion vector is forward or backward de- 
synchronizing header information and for providing pends only upon whether the current field is analyzed 
error concealment in the event of uncorrectable bit with respect to a prior or succeeding field, both ele- 
errors in the received data. Each transport block in- 15 ments are realized with similar circuitry, and in fact 
eludes a header including information indicative of the both elements 104 and 105 alternate on a field/frame 
type of information included in the block, e.g., video basis between generating forward and backward vec- 
audio and pointers to the starting points of contiguous tors. The elements 104 and 105 may be realized using 
like data. integrated circuits of the type designated STI 3220 

The HP and LP data streams from the transport pro- 20 MOTION ESTIMATION PROCESSOR available 

cessor 12 are applied to the respective rate buffers 13 from SGS-THOMSON MICROELECTRONICS, In 

and 14, which convert the variable rate compressed order to achieve the necessary processing rates each of 

video data from the processor 12 to data occurring at a the elements 104 and 105 comprise a plurality of such 

substantially constant rate. The rate adjusted HP and integrated circuits operating simultaneously on differ- 

LP data are coupled to forward error encoding ele- 25 ent areas of respective images. 

ments 15 and 16 which a) perform REED SOLOMON Element 109 designated DCT & Quantize performs 
forward error correction encoding independently to the the'descrete cosine transform and quantization of trans- 
respective data streams; b) interleave blocks of data to form coefficients and may be realized using integrated 
preclude large error bursts from corrupting a large circuits of the type designated STV 3200 DISCRETE 
contiguous area of a reproduced image; and c) appends, 30 COSINE TRANSFORM available from SGS-THOM- 
e.g., Barker codes to the data for synchronizing the data SON MICROELECTRONICS. Element 109 will also 
stream at the receiver. Thereafter the signals are cou- be realized with a plurality of such devices operated in 
pled to a transmission modem wherein the HP channel parallel to concurrently process different areas of the 
data quadrature amplitude modulates a first carrier and image. 

the LP channel data quadrature amplitude modulates a 35 Refer to FIG. 1C and assume that frame 16 is cur- 
second carrier displaced from the first carrier by ap- rently available. Previously occurring P frame 13 has 
proximately 2.88 MHz. The 6 dB bandwidth of the been snatched and stored in the buffer memory B 101. 
modulated first and second carriers are respectively In addition a generated predicted frame 13 has been 
about 0.96 MHz and 3.84 MHz. The modulated first stored in one of the buffer storage elements 114 or 115. 
carrier is transmitted with approximately 9 dB greater 40 As frame 16 occurs it is stored in buffer memory A, 102. 
power than the modulated second carrier. Since the HP In addition frame 16 is applied to a working buffer 
information is transmitted with greater power it is much memory 100. As frame 16 occurs, appropriate image 
less prone to corruption by the transmission channel. blocks of data are coupled from the memory 100 to the 
The HP carrier is located in the portion of the fre- minuend input of a subtracter 108. During I frame com- 
quency spectrum of an, e.g., NTSC TV, transmission 45 pression the subtrahend input of the subtracter 108 is 
channel normally occupied by the vestigial sideband of held at a zero value so that data passes through the 
a standard NTSC TV signal. This portion of the signal subtracter 108 unaltered. This data is applied to the 
channel is normally significantly attenuated by the Ny- DCT and quantizer element 109 which provides quan- 
quist filters of standard receivers and thus HDTV sig- tized transform coefficients to elements 110 and 112. 
nals with this transmission format will not introduce SO Element 112 performs inverse quantization and inverse 
cochannel interference. DCT transformation of the coefficients to generate a 
At the receiver the transmitted signal is detected by reconstructed image. The reconstructed image is ap- 
the modem 20 which provides two signals correspond- plied via an adder 113 to, and stored in, one of the buffer 
ing to the HP and LP channels. These two signals are storage elements 114 and 115 for use in compressing 
applied to respective REED SOLOMON error cor- 55 subsequent B and P frames. During compression of I 
recting decoders 21 and 22. The error corrected signals frames no information is added (by adder 113) to the 
are coupled to rate buffers 23 and 24 which receive data reconstructed image data provided by element 112. 
at a variable rate commensurate with the requirements Element 110 performs two functions during I frame 
of the subsequent decompression circuitry. The variable compression. First it performs differential (DPCM) 
rate HP and LP data is applied to a transport processor 60 coding of the DC coefficients generated by element 
25 which performs the inverse process of the processor 109. It then variable length encodes (VLC) the differen- 
12. In addition it performs a degree of error detection tially coded DC coefficients and zero run and variable 
responsive to the parity check bits included in the re- length encodes the AC coefficients generated by ele- 
spective transport blocks. The transport processor 25 ment 109. The VLC codewords are applied to a format- 
provides separated auxiliary data, HP data, LP data and 65 ter 111 which segments the data and appends header 
an error signal E. The latter three signals are coupled to information thereto in conformance with the layers 
a priority deselect processor 26 which reformats the HP illustrated in FIG. 3A. Coded data from element 111 is 
and LP data into an hierarchically layered signal which then passed to the priority select apparatus. Each of the 
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elements 109, 110 and 111 are controlled by a system quent B frames. For both P and B field/frames it should 

controller 116 to cyclically perform the appropriate be noted that DCTs are performed on a block basis 

operations at the appropriate times. (e.g., a matrix of 8x8 pixels), but motion vectors are 

After frame 16 a M B" frame (14) occurs and is loaded calculated for macroblocks (e.g., a 2x2 matrix of lumi- 

into buffer memory 100. Data from frame 14 is coupled 5 nance of blocks or a 16x 16 matix of pixels), 

to both of elements 104 and 105. Element 104, respon- FIG. 4 shows exemplary circuitry in block form 

sive to frame 14 data from memory 100 and frame 13 which may be used to implement the functions of ele- 

data from memory 101, calculates forward motion vec- ments 110 and 111 of FIG. 3. The output format of this 

tors for respective blocks of 16 X 1 6 pixels of image data. circuitry diverges from that normally provided by an 
It also provides a distortion signal which is indicative of 10 MPEG type encoder in that an MPEG output is a bit- 

the relative accuracy of the respective forward motion serial data stream, but the data provided by the exem- 

vectors. The forward motion vectors and the corre- plary circuitry of FIG. 4 is in parallel-bit word format, 

sponding distortion signals are coupled to an analyzer This format is selected to facilitate the implementation 

106. of both the priority select processor and the transport 

Element 105, responsive to frame 14 data from mem- 15 processor. In addition two extra signals are provided 
ory 100 and I frame 16 data from memory 102, gener- which define the code type of each output codeword, 
ates backward motion vectors and corresponding dis- CW, and the length, CL, of each codeword, 
tortion signals which are also coupled to the analyzer In FIG. 4 motion vectors from the analyzer 106 
106. Analyzer 106 compares the distortion signals (FIG, 3) are differentially encoded in the DPCM ele- 
against a threshold, and if both exceed the threshold, 20 ment 127 on a slice basis and coupled to a multiplexer 
provides both the forward and backward motion vec- 129 via a buffer memory 133. Transform coefficients 
tors as the motion vector, and also provides a corre- from the transform element 109 are coupled to a multi- 
spoodisg signal related to the ratio of the distortion plexer 132 and a differential encoding clement DPCM 
signals. Upon reconstruction predicted images are gen- 128. Differentially encoded coefficients from the 
crated using both forward and backward vectors and 25 DPCM 128 are coupled to a second input of the multi- 
corresponding frame data from which derived. An in- plexer 132. During encoding of P or B frames all of the 
terpolated frame is generated from the forward and coefficients are passed directly through the multiplexer 
backward predicted frames in accordance with the ratio 132. During encoding of I frames, the DC coefficients 
of distortion signals. If the distortion signals for both the are selectively differentially encoded by the DCPM 
forward and backward motion vectors are less than the 30 128. The differential encoded DC coefficients and the 
threshold, the motion vector with the corresponding non-differentially encoded AC coefficients are multi- 
lesser valued distortion signal is selected as the block plexed by the multiplexer 132 and coupled to a second 
motion vector. input of the multiplexer 129 via the buffer memory 133. 

After the motion vector has been determined, it is Header information from a format control and header 
applied to the motion compensated predictor 107 which 35 element 126 are coupled to a third input of the multi- 
accesses the appropriate data block defined by the vec- plexer 129. Element 126 includes stored information 
tor from the previously regenerated frame 16 or frame and control circuitry to a) provide the requisite header 
13 or both, stored in the storage elements 114 and 115. information for the different code layers (FIG. 3A) and 
This data block is applied to the subtrahend input of the to b) provide control signals to time division multiplex 
subtracter 108 wherein it is subtracted on a pixel by 40 the header information, motion vectors and the trans- 
pixel basis from the corresponding block of pixel data form coefficients via multiplexer 129. Element 126 is 
from the current frame 14 provided by the buffer mem- responsive to the system control circuitry via the con- 
ory 100. The differences or residues are then encoded in trol bus CB to provide the appropriate headers corre- 
element 109 and the coefficients applied to element 110. sponding to picture size, rate, picture coding type quan- 
The corresponding block vector is also applied to ele- 45 tizer parameters, etc. Certain of the header information 
ment 110. For encoded B and P frames, the DC coeffici- is calculated by element 126 in conjunction with an 
ents are not differentially encoded, but both the DC and analyzer 125. In the MPEG-type format much of the 
AC coefficients are variable length encoded. The mo- header information (e.g., level 5 of FIG. 3A) is variable 
tion vectors are differentially encoded and then the such as the type of block encoding, the type of motion 
differentially encoded vectors are variable length en- 50 vectors, whether a block has zero valued motion vec- 
coded. The coded vectors and coefficients are then tors and or whether all coefficients in a block are zero 
transferred to the formatter 111. The encoded B frames values. The vector information and coefficient infonna- 
are not inverse quantized and inverse transformed in tion is applied to the analyzer 125 to determine these 
element 112 since they are not used for subsequent en- types of header information. Whether a motion vector 
coding. 55 is a forward, backward and or zero valued is directly 

P frames are similarly encoded except that only for- determinable by examination of the vectors. Whether 

ward motion vectors are generated. For example P all coefficients in a block are zero valued is determin- 

frame 19 is encoded with motion vectors associating able by simply accumulating the magnitudes of the 

corresponding blocks of I frame 16 and P frame 19. vectors included in a block. Once the type of variable 

During encoding of P frames, element 112 provides 60 header data is determined, it is assigned a codeword and 

corresponding decoded residues and element 107 pro- provided to the multiplexer 129 at the appropriate time, 

vides the corresponding predicted P frame. The pre- The element 126 also provides information relating to 

dieted frame and the residues are added in adder 113 on the codeword type currently being multiplexed, i.e., 

a pixel-by-pixel basis to generate the reconstructed header information, motion vector information, DC 

frame which is stored in the one of storage elements 114 65 coefficients, AC coefficients. 

and 116 not containing the frame information from The time division multiplexed information is coupled 
which the predicted P frame is generated. The recon- to a variable length encoder 130 which is also con- 
structed and stored P frame is used for encoding subsc- trolled by element 126. In the figure the VLC control is 
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shown provided by the codeword type signal. The 
different code types are variable length coded accord- 
ing to different VLC code tables and thus it is appropri- 
ate to utilize the code type signal for such control. 

The VLC 130 may include a zero-run encoder for 5 
encoding zero runs of the AC coefficients and a plural- 
ity of Huffman code tables addressed by the respective 
codewords passed by the multiplexer 129 for variable 
length encoding the transform coefficients and the mo- 
tion vectors. The particular table utilized is enabled by 10 
the code type signal. Each of the code tables may in- 
clude corresponding tables programmed with the code 
lengths of the respective variable length codewords. 
The codewords CW and the code lengths CL are pro- 
vided concurrently on separate busses in parallel-bit 15 
format. In general the header information is not variable 
length coded and is passed unaltered by the VLC 130. 
However, the VLC 130 includes code length tables 
responsive to the code type signal to provide the code 
lengths of the header codewords. Alternatively, a bit 20 
counter may be included in the VLC to count the num- 
ber of bits of these data. 

The element 126 also controls the writing and reading 
of data provided to and from the buffer memory 133. 

FIG. 5 illustrates exemplary apparatus for perform- 25 
ing the priority selection process. This apparatus may 
operate in several modes. For example, data may be 
prioritized on an equal basis for the different field/frame 
types, or on an unequal basis for the different field/- 
frame types. In the latter instance assume that the HP 30 
channel passes 20 percent of the total data transmitted 
and that three percent of the HP channel is consumed 
by auxiliary data. If the video data is quantized for 
maximum transmission channel efficiency, 17.53% of 
the video data may be allocated to the HP channel. In 35 
the former instance, the high priority data for the I, P 
and B frames may be assigned in for example, the ratio 
of a:p:l respectively. The values a and /3 may be user 
selectable and/or determined on a statistical basis from 
the amount of code data from prior encoded frames. 40 

Refer to FIGS. 5 and 5A. In the following descrip- 
tion, numbers in square brackets correspond to process 
blocks of FIG. 5A. Data from the variable length en- 
coder 130 is coupled to respective input ports of two 
buffer memories 150A and 150B and to a data analyzer 45 
152. The respective buffers include enough memory to 
store for example a slice of data. The buffers 150A and 
150B are operated in "ping-pong'* fashion to alternately 
write slices of data and read slices of data. Thus while 
buffer 150A writes data from, e.g., slice n, buffer 150B 50 
reads data from slice n— 1. 

As data is written to a particular buffer, the analyzer 
152 generates a codeword number CW#i for each code- 
word and stores the CW#t in association with the cor- 
responding codeword. The analyzer also calculates the 55 
point, or codeword, at which the data should be split 
between HP and LP channels. The calculation is deter- 
mined for the amount of data stored in the buffer. There 
are four general types of data including Header Data, 
Motion Vectors, DC coefficients and AC coefficients. 60 
The DC and AC coefficients over a block occur in the 
order of DC coefficient first followed by codewords 
representing the AC coefficients in generally descend- 
ing order of importance. The total number of bits are 
counted for all the codewords in the buffer. Then the 65 
codeword at which the sum of bits is just greater than 
the HP percentage is identified by a codeword number, 
CW#j. This number is applied to a switching element 
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153A (153B), and used to control the multiplexer 155A 
(1S5B). After the codeword number CW#j is identified, 
the codewords, codelength data, codeword type data 
and codeword numbers arc read in parallel from the 
buffer 150A (150B). The codewords, codelengths and 
codetypes are applied to the input of a multiplexer 155A 
(155B), and the codeword numbers are applied to an 
input of the switching element 153A (153B). As the data 
is read from the buffer, the switching element 153A 
(153B) compares the codeword numbers to the calcu- 
lated number CW#j. For all codeword numbers less 
than or equal to CW#j, the switching element provides 
a control signal which conditions the multiplexer 155 A 
(155B) to pass the corresponding data to the HP chan- 
nel via a further multiplexer 156. For codeword num- 
bers greater than CW#j, the multiplexer 155A (155B) is 
conditioned to pass the corresponding data to the LP 
channel via multiplexer 156. The multiplexer 156 is 
conditioned to pass HP and LP data provided by the 
buffer 150A, (150B) which is currently being read. 

The analyzer 152 is responsive to the codelength 
signals, and the code type signals. Responsive to the 
code type signals, the analyzer generates [502] code- 
word numbers for each occurring codeword. For exam- 
ple, each codeword representing header information is 
assigned the number (—2). Each codeword represent- 
ing motion vectors and DC coefficients are assigned the 
numbers (—1) and (0) respectively. Successive AC 
codewords are assigned ascending integers i from 1 to n 
on a block-by-block basic. 

The analyzer 152 also includes an accumulator 
which, responsive to the codelength and type signals, 
independently sums the number of bits of the code- 
words of each code type entered in the buffer 150A 
(150B). These sums are added [504] to provide the total 
number of codeword bits contained in the buffer. The 
total sum is multiplied by the decimal equivalent of the 
percent to be allotted to the HP channel to produce a 
check sum [512]. Thereafter the respective code type 
sums are sequentially added [508] in ascending order of 
codeword number CW#i to produce partial sums. Each 
partial sum is compared [512] with the check sum until 
the partial sum exceeds the check sum. The codeword 
number CW#j associated with the immediately previ- 
ous partial sum is the last codeword within a block to be 
assigned to the HP channel [512-518]. All succeeding 
codewords, Le., CW#j+l to CW#n, for respective 
blocks are assigned to the LP channel. 

Respective HP and LP data from the priority selector 
is arranged in transport blocks designed to enhance 
signal recovery and error concealment at the receiver. 
The transport block format is illustrated in FIG. 6. An 
exemplary HP transport block includes 1728 bits and an 
LP transport block includes 864 bits. Respective trans- 
port blocks may include more or less than a slice of 
data. Thus a particular transport block may include data 
from the end of one slice and data from the beginning of 
the next subsequent slice. Transport blocks including 
video data may be interleaved with transport blocks 
containing other data, e.g., audio. Each transport block 
includes a service type header ST which indicates the 
type of information included in the respective transport 
block. In this example the ST header is an 8-bit word 
which indicates whether the data is HP or LP, and 
whether the information is audio, video or auxiliary 
data. Four bits of the 8-bit word are used to represent 
the ST information and four bits are used to provide 
Hamming parity protection of the ST information bits. 
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Each transport block includes a transport header TH all bits in the transport block. The FCS may be gencr- 
immediately following the ST header. For the LP chan- ated using a cyclic redundancy code, 
nel the transport header includes a 7-bit macroblock FIG. 7 illustrates exemplary apparatus of the trans- 
pointer, an 18-bit identifier and a 7-bit record header port processor. In the figure an arbiter 213 interleaves, 
(RH) pointer. The transport header of the HP channel 5 via a multiplexor 212, transport blocks of video data 
includes only an 8-bit record header (RH) pointer. The from a multiplexer 211, audio data from a memory 214 
macroblock pointer is used for segmented macroblock and auxiliary data from a memory 215. The audio data 
or record header components, and points to the start of » provided in transport block form by the source 216 
the next decodabie component. For example, if the and applied to a firtt-in first^ut memory 214. The auxtl- 
particular transport block includes macroblock data 10 iary data is provided in transport block form by the 
associated with the end of slice n and the beginning of *>urce 217 to a first-in first-out memory 215. The for- 
slice n+1, the data from slice n is placed adjacent the **s of the audio and auxiliary data transport blocks 
transport header and the pointer indicates that the next "»V d f cr from format of the video transport 
decodabie data is adjacent the transport header TH. W«*s, however all transport blocks will include a lead- 
Conversely, if a record header RH is adjacent the TH, " type header, and preferab y will be of equal 
the first pointer indicates the byte position following the lcn # h - The artiter 213 respondsto the level of occu- 
record header RH. A zero valuedmacroblock pointer W ° f * uff " s 21 * ** d 207 fasmon t0 
indicates, that the transport block has no macroblock — £^ 

trum one record header, and their positions are vanab k *» Hp ^ for M 
within the transport block. A record header occurs at ^ fa ^ Lp ^ 
*e begmmog of each slice of macroblock data in the ^ ^ ^ ^ ^ 
HP and LP channel. No record headers are mcluded m „ fa / lQ ? codcword) CW( codclcngth , C L, and code 
transport blocks that include only video data header rm ^ fr()m ^ ^ m led 
information. The record header (RH) pointer points to ^ tf n controncr 218) and thc codcwords a„ d 
the byte position containing the start of the first record code t ^gnal are couplcd to a varia ble word length 
header in the transport block Note, the first record tQ fjxC(J word lcn ^ h convcrtor m ^ convenor 201 
header in a transport block is placed at a byte boundary ^ ^ cVtXizes thc variable length codewords into, for ex- 
That is, if a variable length code precedes the record g . bh bytcs m ordcr to reduce the amount of 
header, the variable length code may be bit-stufied to stQrage spacc rcquired of ^ ratc buffers 13 14. The 
insure that the start of the record header occurs at a bit convcrtor 201 may be of the type described in U.S. Pat. 
position which is an integral number of bytes from the No 4,914,675. The fixed length words provided by the 
beginning of the transport block. The record headers 33 conV ertor 201 are temporarily stored in the buffer 207. 
are placed at byte boundaries to enable thc decoder to The transport controller 218 responds to the CW, 
locate them since they are embedded in a stream of C L, TYPE and CW#j data to construct the transport 
concatenated variable length codewords. A zero valued Wock headers (ST, TH, RH) and applies these headers 
RH pointer indicates that there are no record headers in t0 a header buffer 208, which may be internal to the 
the transport block. If both the record header pointer 40 controller 218. Responsive to the code lengths, code 
and the macroblock pointer are zero valued, this state types ^ codewords, the controller 218 generates the 
indicates that the transport block includes only video requisite timing signals for interleaving (via the multi- 
data header information. plexer 209) the fixed length video data words and trans- 
Trie 18-bit identifier in the LP transport header iden- port block header information into transport blocks of 
tifies the current frame type, the frame number (modulo 45 predetermined numbers of bits. 
32), the current slice number, and the first macroblock The transport blocks provided by the multiplexer 209 
contained in the transport block. are coupled to one input of the multiplexor 211 and to 
Following the transport header is either a record the input terminal of a frame check sequence coder FCS 
header, RH, or data. As indicated in FIG. 6 the record 210, the output of which is coupled to a second input of 
header for the video data in the HP channel includes the 50 the multiplexer 211. The FCS 210, responsive to trans- 
following information: A 1-bit FLAG which indicates port block data forms two-byte error check codes for 
if a header extension, EXTEND, is present Following respective transport blocks. The multiplexer 211 is con- 
the FLAG is an identifier IDENTITY, which indicates ditioned to pass respective transport blocks provided by 
a) the field/frame type I, B or P; b) a field/frame num- the multiplexer 209, and then to append the 16-bit or 
ber (modulo 32) FRAME ID; and c) a slice number 55 two-byte FSC code from element 210 to the end of the 
(modulo 64) SLICE IDENTITY. Following the identi- transport block. 

fier the record header includes a macroblock priority In the foregoing description of the transport proces- 

break point indicator, PRI BREAK (j). The PRI sor it is assumed that all of the header information pro- 

BREAK(j) indicates the codeword number CW#j, vided by the compressor 10 is included in the video date 

developed by the analyzer 152 of the priority selector, 60 stream provided by the transport processor. It should 

for dividing the codewords between the HP and LP be recognized that much of the video data header infor- 

channels. Lastly, an optional header extension may be mation is also included in the transport headers and as 

included in the HP record header. such provides redundant information. In an alternative 

The record header incorporated in the LP channel arrangement, the controller 218 may preclude the con- 
includes only an identifier, IDENTITY, similar to the 65 verier 201 from accepting video header data which 
identifier implemented in the HP channel. would be redundantly included in the transport block 

Each transport block is terminated with a 16-bit headers, thus enhancing the overall coding efficiency, 

frame check sequence, FCS, which is calculated over At the receiver the excised video header data may be 
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reconstructed from the transport block header informa- 
tion and reinserted in the video data stream. 

At the receiver, detected signal is applied to forward 
error correction circuits 21 and 22 to perform error 
correction on the respective HP and LP signals. Error 5 
corrected data is then applied to the transport processor 
25 via rate buffers 23 and 24. Even though the detected 
data has undergone error correction in the FEC circuits 
21 and 22, certain errors occurring during signal trans- 
mission may not be correctable by the FEC circuits. If 1° 
these errors are allowed to pass to the decompression 
circuitry, very objectionable corruption may occur in 
the reproduced image. To preclude such happenstance 
each transport block includes independent error detec- 
tion codes to identify the occurrence of errors which 15 
pass through the FEC circuits, and responsive to such 
error indications the system may provide appropriate 
error concealment. 

FIG. 8 illustrates the transport processor 25 included 
in the receiver portion of the system. Two such proces- 
sors are required, one for the HP channel and one for 
the LP channel. If it is known a priori that audio or 
auxiliary data will always be excluded from a particular 
channel, the corresponding elements may be eliminated ^ 
from such channel transport processor. 

In FIG. 8 data from the rate buffer 23 or 24 is applied 
to an FCS ERROR detector 250 and a delay element 
251. Delay element 251 provides a delay of one trans- 
port block interval to allow the detector 250 to deter- ^ 
mine if any errors are present in the corresponding 
transport block. The detector 250 provides an error 
signal E indicating the presence or absence of errors in 
the transport block. The error signal is applied to the 
input port of a one-to-three demultiplexer 253. The 35 
delayed transport block data is also applied to the input 
port of the multiplexer 253. Delayed transport block 
data is also coupled to a service type detector (ST DE- 
TECT) 252, which examines the ST header and respon- 
sive thereto conditions the multiplexer 253 to pass the ^ 
transport block data and corresponding error signal to 
the appropriate one of the audio, auxiliary or video 
signal processing paths. Even though an error may be 
detected in a transport block, the ST code may still be 
relied upon because it has been independently Hamming 45 
code protected. 

In the respective audio, auxiliary and video signal 
processing paths the error signal may be utilized in 
different ways to effect error concealment. In the video 
signal processing path the error signal may be utilized in 50 
alternative ways depending upon the error concealment 
circuitry included in the decompressor 27. In the sim- 
plest case assume that the decompressor 27 includes a 
display memory in which information is updated as 
information is decoded. If no information is received for 55 
a particular portion of an image, the corresponding 
portion of the display memory is not updated. Those 
image portions that are not updated are simply repeated 
in successive frames until new data is received. If it is 
assumed that error concealment by repeating inform- 60 
tion from frame-to-frame is acceptable, in the video 
signal processing path the error signal may be utilized to 
simply excise transport blocks with detected errors 
from the video data stream. Alternatively, for more 
sophisticated error concealment the transport block 65 
data may be retained but tagged with the error indica- 
tion to alert the decompressor to perform alternative 
error concealment functions. 
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In the video signal processing path, the transport 
block data and error signal are coupled to a processing 
element 256 which excises the FSC code and the trans- 
port block headers ST, TH and RH from the data 
stream. It may also be arranged to delete entire trans- 
port blocks in which errors have been detected. Ele- 
ment 256 provides the video data with transport block 
headers excised, the error data and the transport head- 
ers to the priority deselect processor 26 on separate 
busses. 

The FEC circuits 21 and 22 provide the received data 
in fixed length words corresponding to the fixed length 
words provided to the FEC circuits 15 and 16 of the 
encoder. As such the transport block header data oc- 
curs on byte boundaries which are either predetermined 
(ST, TH and FCS) or are identified (RH) by the trans- 
port header. Thus it is a relatively simple matter to 
identify and extract the requisite transport block head- 
ers from respective transport blocks. 

FIG. 9 illustrates and exemplary priority deselect 
processor. The priority deselect processor accepts data 
from the receiver transport processor and reconfigures 
it to the form applied to the encoding priority select 
processor 11. In order to do so respective codewords of 
the data stream have to be identified, that is the code- 
word CW#j in each block must be detectable. Since the 
data is in the form of concatenated variable length 
codes, it must be at least partially VLC decoded to 
define the codeword boundaries. Once the codeword 
boundaries are determined, the codewords may be 
counted to find CW#j (in the HP channel). After the 
codeword boundaries are identified the codewords may 
easily be parsed into respective parallel-bit VLC code 
form. 

In FIG. 9 similar circuits (270, 271, 272, 273) and 
(276, 277, 278, 279) responsive to HP and LP data re- 
spectively, parse the incoming data into parallel-bit 
VLC codewords. The HP and LP codewords are re- 
spectively coupled to a multiplexer 274 which, respon- 
sive to a deselect controller 275 recombines the data 
into a data sequence similar to that provided by the 
compressor 10. 

Consider the HP channel circuitry 270-273. Video 
data from the element 256 (FIG. 8) is applied to a buffer 
memory 270 and a deselect controller 271. In addition 
the HP transport block headers are applied to the con- 
troller 271. The video data, absent errors, will occur in 
predetermined cyclical sequences. Particular points in a 
sequence are ^identifiable from the transport block 
header information. Once a start point is identified, 
decoding proceeds in the predetermined sequence. The 
deselect controller 271 is programmed to condition the 
variable length decoder VLD for operation according 
to this sequence. For example, assume that the transport 
header indicates that current data is from an I field and 
that a record header occurred at byte z. The record 
header was placed at the beginning of a slice, thus the 
entry point of a slice can be identified relative to byte z. 
At this point the slice header of known bit/byte coding 
format is known, which header is followed by a mac- 
roblock header of known bit/byte coding format, fol- 
lowed by block data in known coding format, and so on. 
Thus, responsive to the transport header information 
the controller 271 establishes the decoding sequence of 
the VLD 272, i.e., which VLD decoding tables to use 
for which grouping of VLC codewords. Note that 
since, e.g., the slice header in the data stream is not 
variable length encoded, the controller may be ar- 
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ranged to compare common slice header information 
with transport header information for entry point con- 
firmation. 

The video data from the buffer 270 is coupled to the 
VLD 272 which concatenates a number of the fixed 5 
length codewords, and examines the leading bits of the 
concatenated codewords for a recognizable codeword 
according to the type of coding expected vis-a-vis the 
normal cyclical sequence. Once a particular number of 
leading bits is recognized as a valid codeword, these bits 1° 
are output as a parallel -bit codeword CW to a buffer 
store 273. In addition the expected codeword type, T, 
and codeword length CL are produced and applied to 
the buffer store 273. As the codewords are loaded into 
the buffer store 273 they are indexed by the deselect 15 
controller 275. 

DC and AC coefficient codewords are encoded ac- 
cording to different statistics, and the coefficients of 
respective blocks within a macroblock are concatenated 
without including end of block identifiers. In general 
however the DC coefficient of the first block in a mac- 
roblock is identifiable by its position within the bit 
stream. The VLD cannot discern between the last AC 
coefficient of one block and the DC coefficient of the ^ 
next block. Identification is provided by the CW#j 
included in the transport block header information, The 
CW#j identifies the last AC coefficient codeword in 
each block in a slice. To find the codeword numbered 
(j) the deselect controller 275 monitors the code types T ^ 
provided by the VLD. The controller 275 counts the 
AC type codes T, and when j have occurred the con- 
troller 275 communicates with the VLD 272 to reset the 
cycle to a DC coefficient decoding event. 

Elements 276-279 in the LP channel operate in a 35 
similar manner. The LP data however is expected to 
include only AC coefficient codewords. The AC code- 
words for respective blocks within a macroblock are 
separated by end of block (EOB) codes, hence there is 
no need to count codewords. The operation of VLD 40 
278 may simply be to decode words which are all coded 
according to one coding table. The position of the first 
macroblock in transport block is identified by the re- 
spective transport header, and each successive macrob- 
lock is identified by record headers. This information is 45 
evaluated by the deselect controller 277 for controlling 
the VLD 278 for indexing the codewords in the storage 
buffer 279. 

Responsive to the indexed information and the type T 
codewords stored in the storage buffers 273 and 279, the 50 
deselect controller 275 concatenates the HP and LP 
codewords stored in the storage buffers 273 and 274 via 
a multiplexer 274. The controller identifies a macrob- 
lock, conditions the multiplexer 274 to pass data from 
the HP channel and reads the respective HP data from 55 
storage buffer 273 up to codeword CW#j of block one 
of the macroblock. It then conditions the multiplexer to 
pass data from the LP channel and reads the AC coeffi- 
cient codewords corresponding to the same block one, 
until an EOB type code occurs. Thereafter controller 60 
275 conditions the multiplexer 274 to pass data from the 
HP channel and commences reading HP data corre- 
sponding to block two of the macroblock. After the 
codeword corresponding to CW#j is read, the control- 
ler again switches to read LP data for block for block 65 
two from the LP channel, etc. 

If while reading data from the high priority channel 
an EOB code occurs before the codeword correspond- 
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ing to CW#j occurs, the controller 275 is reset to read 
the next block of data from the high priority channel. 

The cyclic nature of occurring codewords may be 
variable. For example some macroblocks within a slice 
may not be coded and/or some blocks within a macrob- 
lock may not be coded. This information is included in 
the respective slice and macroblock headers. In order to 
establish and maintain the appropriate decoding cycles, 
the controller 275, responsive to the codeword types 
examines the slice and macroblock header codewords 
to determine the numbers of blocks in respective mac- 
roblocks and the number of marcoblocks in respective 
slices. Responsive to these numbers the controller 275 
counts particular decoding operations and determines 
when certain decoding functions have been completed, 
and restarts a decoding cycle. Note that as indicated 
previously more than one record header may be in- 
cluded in a transport block, but only the first record 
header is identified by the transport block header. As 
such only the first record header in a transport block 
may be excised by the element 256. In order to identify 
and extract the information from such record headers, 
and excise such record headers from the data stream, 
the controller 275 counts the number of macroblocks 
processed by the VLD 272, and on completion of the 
last macroblock in a slice recognizes the next occurring 
data in a transport block as a record header. It thereaf- 
ter reads the information in the record header, to estab- 
lish subsequent cyclic operations, and precludes its pas- 
sage to the buffer 273. 

The controllers 271, 275 and 277 are indicated in the 
figure as three separate elements, however it should be 
appreciated that they may be subsumed in a single con- 
troller element. 

The circuitry of FIG. 9 does not provide variable 
length decoded data but rather only parses respective 
variable length codewords, and provides them in a form 
similar to the data provided at the output of the com- 
pressor 10. As such circuitry substantially complemen- 
tary to compressor 10 may be utilized for the decom- 
pressor 27. It should be recognized however that the 
circuitry of FIG. 9 may be arranged to provide decoded 
variable length codes obviating a VLD in the decom- 
pressor circuitry. 

In the FIG. 9 provision is made for a variety of error 
concealment methodologies. For example, even though 
a transport block includes an error, the data for that 
block may be processed and passed on to the decom- 
pressor. In this instance an error flag is generated for 
each data word of the transport block and carried along 
with the codewords applied to the decompressor. The 
error flags are provided by the deselect controllers 271 
and 277 and coupled to the buffer stores 273 and 279, 
wherein they are stored in memory locations corre- 
sponding with the associated erroneous transport block 
codewords. 

In an alternative system wherein corrupted transport 
blocks are not processed, assume that a LP transport 
block is lost. The LP channel provides coefficient data 
of lesser importance to the reconstruction of images, 
and in fact DCT blocks may be decompressed without 
these coefficients, albeit the respective decompressed 
blocks will exhibit less spatial resolution. Therefore, 
when LP erroneous transport blocks are excised from 
the data stream, and data is being reconstructed at the 
multiplexer 274, after each block codeword CW#j of 
HP data, an EOB code is inserted in liew of LP data. 
The EOB code is provided by the controller 275 and 
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multiplexed into the data stream via the multiplexer 274. The VLD 306 includes circuitry to decode the van- 
To indicate that the EOB for the respective blocks is a able length encoded motion vectors and to perform 
forced or artificial EOB, an error flag may be carried inverse DPCM coding of the motion vectors as appro- 
along with the EOB signal. The forced EOB signal is priatc under the control of the controller 302. Decoded 
designated EOBE. 5 motion vectors are applied to a motion compensated 

The controller 275 is provided the transport header predictor 304. Responsive to the motion vectors the 

information for both channels and indexes the block predictor accesses corresponding blocks of pixels stored 

information available in the storage buffers 273 and 279. in °ne (forward) or both (forward and backward) of the 

The macroblock and block data occur in a known se- buffer memories 314 and 316. The predictor provides a 

quence, enabling the controller to recognize lost data, 10 block of data (from the one of the buffer memories) or 

and to provide and append EOBE codes to the HP data interpolated block of data (derived from respective 

for lost LP data. blocks from both buffer memories) to a second input of 

In general very few errors are expected to occur in toe adder 312. 

the HP channel due to the robustness by which it is Decompression is performed as follows. If a field/- 

transmitted. However, if an error does occur in the HP 15 frame of b ? ut * d *° « intraframe encoded there 

channel, the data in the LP channel corresponding to «* n ° motIon vectors and the decoded DCT coeffic,- 

blocks of data lost in the HP channel becomes meaning- f nts correspond to blocks of pixel values. Thus for 

less. The controller 275 is programmed to recognize lost *traframe i encoded data the predictor 304^phes a zero 
HP data via an intermption of the normal sequence of ^ value to ^ der * 12 f K d l * e d ^ 0de «?? T ^ C0C ^ C, " 

information identified by the nonerroneous transport 20 T^T^ T * *V ^ f 

block headers. When lost HP data is detected, the coVre- ^ **** where they are s^red forreadout accord- 

sponding LP data is flushed from the storage buffer 279, »* ^^^^^ Z^t^luT d 

that is, ifis not passed on to the decompressor. In addi- £ e ^i?^ 

' ^ \. „. . j * j» j 316 for use in forming predicted image values for de- 

tion, die controller 275 may be arranged to provide 25 mQtion ^ frames ( | or p) , 

error data to the decompressor, m a form which identi- If a 6 field/frame 0 7 { t data corresponds to a for- 

fies lost information, ue., macroblock or slice or frame waf<J motion com f ed P fl el d/ f rame , the decoded 

data which are not being provided from the priority correspond to residues or differences be- 

deselect processor. tween the present f ie ld/frame and the lastmost occur- 

The controller 275 is responsive to the overall system 3Q ^ j frame The pr edictor 304 responsive to the de- 
controller via the control bus ^CB, to > nutiahze : ori reini- cqM mQtion vcctors acccsscs thc corresponding block 
tialize the controllers 271, 277 and VLD s 272, 278 on of j frame daU stored ^ either buffer memory 3 14 or 
start up and channel changes, etc. In addition the con- 31fi and provides this block of data to the adder wherein 
troller 275 communicates with the transport processor respective blocks of residues provided by the inverse 
25 and rate buffers 23 and 24 for controlling the rate of 35 DCT circuit 310 are added to the corresponding block 
information provided to the priority deselect circuitry. of pixe1 ^ pr0 vided by the predictor 304. The sums 

FIG. 10 illustrates an exemplary arrangement of the generated by the adder 312 correspond to thc pixel 

decompression apparatus 27. va i ues f or the respective blocks of the P field/frame, 

Error concealment will not be discussed with respect which pixel values are applied to the display RAM 318 

to this apparatus as it is not the subject of this invention. 40 t0 update respective storage locations. In addition the 

Suffice it to say that error data from the priority dese- pixc i va j ues provided by the adder 312 are stored in the 

lect processor is applied to the decompression control- one 0 f buffer memories 314 and 316 not storing the I 

ler 302 to preclude updating areas of the video display field/frame of pixel data utilized to generate the prc- 

RAM 318 corresponding to missing blocks of data, and dieted pixel data. 

that the apparatus responds to forced EOB codes as if 45 For bidirectionally encoded (B) field/frames the op- 

they are normally occurring EOB codes. eration is similar, except predicted values are accessed 

Generally the circuitry of FIG. 10 is arranged to from the stored I and P pixel data stored in both buffer 

decompress video data provided in MPEG-like hierar- memories 314 and 316 depending upon whether the 

chical format. The video data provided by the multi- respective motion vectors are forward or backward 

plexer 274 of the priority deselect processor is applied 50 vectors or both. The generated B field/frame pixel 

to a buffer memory 300. This data is accessed by the values are applied to update the display RAM 318, but 

decompression controller 302 wherein header data is are not stored in either of the buffer memories, as B 

extracted to program the controller 302. The variable field/frame data is not utilized for generating other 

length codewords corresponding to DCT coefficients Held/frames of picture data. 

are extracted and applied to a variable length decoder 55 FIG. 10A shows a combined priority deselect prpces- 

(VLD) 308 and the variable length codewords corre- sor and decompressor. In FIG. 10A elements desig- 

sponding to motion vectors are applied to the variable nated with the same numbers as elements in FIG. 10 are 

length decoder (VLD) 306. The VLD 308 contains similar and perform like functions. The VLD's 308 and 

apparatus for performing variable length decoding, 306 have been substituted by DPCM's 409 and 408 

inverse run length decoding and inverse DPCM coding 60 which perform run length and DPCM decoding as 

as appropriate under the control of the controller 302. appropriate. HP and LP data from the transport proces- 

Decoded data from the VLD 308 are applied to an sor 25 are respectively applied to buffer memories 400 

inverse DCT circuit 310 which includes circuitry to and 402. Transport headers H DATA from the HP and 

inverse quantize the respective DCT coefficients and to LP channels are applied to a subcontroller 404 and 

convert the coefficients to a matrix of pixel data. The 65 communicated to the decompression controller 407. 

pixel data is then coupled to one input of an adder 312, The subcontroller may comprise a subset of instructions 

the output of which is coupled to the video display ram of the controller 407. Responsive to the header data, the 

318 and buffer memories 314 and 316. subcontroller aligns the data in the buffer memories 400 
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and 402 to correspond to the same data slices. The data for a transport block error. If an error is detected a LP 

in the buffer memories are applied to parallel to serial error flag is set and new data is loaded until no error is 

converters 401 and 403 which respectively provide present. If no error flag has been set, a jump is made to 

serial data streams to respective input terminals of a 717. This jump indicates that the system is operating in 

multiplexer 405. Serial data from the multiplexer 405 is 5 the normal sequence, and decoding proceeds between 

applied to a VLD 406. VLD 406 accepts data a bit at a HP and LP data as appropriate (709, 717). Alternatively 

time and generates variable length decoded data to the if an error flag has been set 713, then the system must 

decompression controller 407. Decoded video header search for the next valid data entry point. The current 

data is stored in the controller 407, and decoded coeffi- LP transport header is examined for a macroblock ad- 

cients and motion vectors are respectively applied by 10 dress or a RH 714. If none are available a jump is made 

the controller to the DPCM's 409 and 408. to 710 and new data is accessed. If one is available, the 

Controller 407 initially conditions the multiplexer 405 LP data is advanced to that entry point 715. Note if 

to pass HP data so that it accesses video header data there is an HP error flag set the system ignores a MB 

first. The controller 407 reads decoded video header entry point and advances to the entry point associated 

information, and responsive thereto establishes the ap- 15 with a RH. The transport header is examined 716 for 

propriate decoding sequence. After the controller be- the frame and slice identifiers. At this point the LP data 

gins accessing data corresponding to macroblock coeffi- is checked for coincidence with the HP data. If it lags 

cients, it counts the number of coefficient codewords the HP data a jump is made to 710 to advance the LP 

decoded, and subsequent decoding j such codewords data. If there is no lag, a check is made for alignment of 

conditions the multiplexer 405 to pass data from the LP 20 HP and LP MB's. If the LP MB leads the current HP 

channel. Upon receiving an EOB codeword in the LP MB a wait is initiated. Conversely if the LP MB lags the 

data, the controller conditions the multiplexer to again HP MB the LP MB data is advanced to correspond 

pass data from the HP channel. The controller 407 is with the current HP MB. The LP channel then waits 

arranged to recognize missing LP data and effectively for the jth HP codeword of the current block to be 

substitute EOB's therefor, that is, after counting j HP 25 decoded. 

decoded coefficient codewords, to proceed to the next As indicated previously, there may be record headers 

HP block of data. imbedded in the data stream that are not identified by 

Referring to FIG. 10B, the control circuit 407, re- the transport headers. These record headers are found 

sponsive to a channel change or loss of signal provided by counting (709, 717) the number of macroblocks that 

by the system controller performs an initialization pro- 30 are decoded. There are a predetermined number of 

cedure 700 wherein the VLD 406 is reset, the multi- macroblocks in each slice, and therefore when this num- 

plexer 405 is conditioned to pass HP data and the sub- ber of macroblocks are decoded the next occurring data 

controller is conditioned to test for GOP data. Thereaf- will be recognized as e.g., two bytes of record header 

ter a signal is sent 702 to load, e.g., a transport block of data. This data is read by the controller (708, 716) and 

data in the buffer 400. A check 704 is made to determine 35 used for the next sequence of decoding operations. In 

if an HP transport block error occurred, and if so the addition there are a predetermined number of bytes in a 

next transport block is loaded. In addition an internal transport block, and the bytes are counted (709, 717) to 

error flag is set 703. If no error is set HP data is pro- indicate when to access the next transport blocks (702, 

vided to the VLD and decoded 709 until either an EOB 710). 

occurs or the jth codeword is decoded. If an error has 40 The FIG. 10B system is arranged to provide serial 

been indicated for corresponding blocks of data in the data to the VLD 406. However it should be recognized 

LP channel an EOB code is inserted after each jth that a VLD may be selected which operates on variable 

decoded codeword and the system continues to provide length codewords occurring in parallel bit format In 

HP data to the VLD. In addition if the system has failed this instance the parallel to serial converters 401 and 402 

to align LP data with the HP data EOB codes are in- 45 may be eliminated. Preferably the data provide by the 

serted after each jth decoded HP codeword. Alterna- buffers will be tri-stated and the output ports of the 

tively, if LP data has been aligned with HP data and no buffers will be wire ORed to the input port of such 

LP error flag has been set, after decoding the jth HP VLD. 

codeword a switch is made to process LP data (from FIG. 11 illustrates exemplary modem circuitry for 

709 to 717). At this point the multiplexer is set to pass 50 both the transmitting and receiving ends of the system. 

LP data to the VLD. LP data is decoded 717 until an HP and LP data from the forward error correction 

EOB occurs at which time decoding is switched back to circuits 15 and 16 are applied to respective 64 QAM 

the HP data. modulators 400 and 401. The modulator 400 provides an 

Return to the check point 705. If an error flag has HP analog signal with a — 6 dB bandwidth of appro xi- 

been set for the HP data, the system has to look for the 55 mately 0.96 MHZ. This signal is applied to a 1.5 MHZ 

next available data entry point which is identified by the _ band pass filter 402 to eliminate high frequency hannon- 

RH data. Therefore the system checks 706 for an avail- . ics, and then is applied to an analog signal summer 405. 

able RH. If none is available the process is returned to The modulator 401 provides an LP analog signal with a 

702 to get more data. If an RH is available, the TH is —6 dB bandwidth of approximately 3.84 MHZ. This 

examined for its location 707, and the data in the buffer 60 signal is applied to a 6 MHZ band pass filter 404 to 

400 is advanced to the byte boundary that immediately eliminate high frequency harmonics, and then is applied 

followed the RH. to an attenuator 406. The attenuator 406 reduces the 

The RH is examined 708 for the frame and slice iden- amplitude of the LP analog signal by approximately 9 

tification and the associated CW#j. Thereafter decod- dB relative to the HP analog signal. The attenuated LP 

ing of Hp data commences, 709. 65 signal is then coupled to the analog signal summer 405, 

During initialization of the HP channel, the LP chan- wherein it is summed with the analog HP signal to 

nel is similarly initialized. Thereafter a slice of LP data produce a signal with a frequency spectrum similar to 

is loaded 710 in the buffer 402, and a check 712 is made the signal spectrum shown in FIG. 1. The combined 
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signal is applied to a mixer 407 wherein it is multiplied through codeword number CW#j, then low prior- 

by an RF carrier to frequency translate the combined ity data for the same block, 

signal to a frequency band that comports with a stan- 2. The apparatus set forth in claim 1 wherein said 

dard TV transmission channel. The translated signal is second means includes means for associating codeword 

then applied to a band pass filter 408, which tailors the 5 numbers CW#i with respective codewords according 

spectral characteristics of the frequency translated sig- to codeword types, and said fourth means includes 

nal to fit within the standard channel. means for concurrently providing said high priority 

At the receiver, the transmitted signal is detected by codewords and associated codeword numbers CW#i 

a tuner/IF circuit 410 of conventional design, and ap* and detecting the occurrence of the codeword number 

plied to a PLL circuit 413 and an analog-to-digital con- 10 CW#i equal to CW#j. 

verter (ADC) 412. The digitized signal is coupled to 3. The apparatus set forth in claim 1 wherein each 

respective 64 QAM demodulators 414 and 415. The block of low priority data includes an end of block code 

demodulators 414 and 415 include band pass filters at EOB, and said third means includes means for detecting 

their respective input connections to band limit the ^ EO b codes, and responsive to detection of EOB 

spectrum of the signals to be processed thereby to con- 15 codcs segmenting respective blocks of data, 

form to the nominal signal spectrum of the HP and LP 4 In a video signal processing system for processing 

signals. The demodulators 414 and 415 are of conven- digital compre ssed video data conveyed as high and 

tional QAM demodulator design .and are responsive to low priority data m ^ ^ [ow priority channe i s 

clock signals provided by the PLL circuit 413. The respectivelV( ^ ^ low priority data being gen- 

PLL 413 develops the requisite clock signals via phase 20 emed ffom encoded ^p,^ video data occurring 

locking a signal developed by a voltage controlled os ; M b1ocks of ^^o^ respe ctive blocks including 

cillator to one of the two earners attendant the QAM p)uralities of codcw ords occurring in descending order 

signals. r of importance for image reproduction, and wherein 

The invention has been described in terms of an , _ T ^, , ^ . ^j.„.«»*i ~r kwv« 

w ~~~, ... . , , « . . ^ data through a jth codeword type of respective blocks 

MPEG like signal however it should be appreciated 25 _ * n ~ u . . ■ Ii. n 

... li * 1 » . are allocated as nigh priority data and the remaining 

that it is amenable to processing signals compressed in , , - , / , « . , „ p ,7, 

. - „ . . ^ . * c -M- 1 codewords for respective blocks are allocated as low 

other formats and by other transforms. The only re- . . . * r v • < JV u • ■» 

quirement on the type of compression is that it provide P" 0 "^ data ' ^'"f f ° r c ™ b ™?8 -«J P"° n * 
data that can be prioritized in hierarchical levels, as for data fn ? m ^t.ve blocks of data >n said h.gh pnonty 
example sub band or pyramid transforms. 30 J*"""* ,™ th l ow data fr ™ correspond** 

What is claimed is- blocks of data from said low pnonty channel compns- 

1. In a television processing system for decoding mg: ^ , . . . . _ A , . 
compressed video signal encoded in such fashion that mea * s responsive to high pnonty data conveyed in 
data of greater and lesser importance for image repro- ™» high pnonty channel for identifying respec- 
duction are transmitted as high and low priority data in 35 ttve blocks ° f ta S h pnonty data; 
high and low priority channels respectively, said data mca » s responsive to low priority data conveyed m 
including variable length codewords CW of differing ow pnonty channel for identifying respective 
types, said types occurring in a predetermined sequence blocks of low pnonty data; 
of blocks of data, with data from respective blocks mcans for »PI*ndiiig codewords of low pnonty data 
occurring in both said high and low priority channels, 40 from respective blocks to codewords from corre- 
and wherein the data of said high and low priority chan- spondmg blocks of high pnonty data to form 
nels are conveyed in respective transport packets hav- blocks of data representing respective image areas, 
ing header data including block identifiers, and the 5 - The apparatus set forth in claim 4 wherein at least 
header data of the high priority channel transport pack- a portion of said high pnonty data is vanable length 
ets including codewords CW#j identifying numbers of 45 encoded and successive codewords are conveyed with- 
codewords included in groups of one of said types, out delineation, a codeword number CW#j identifying 
apparatus for combining said data from said high and said jth codeword type is separably conveyed with said 
low priority channels into a single data stream compris- high priority data, and said means responsive to con- 
ing, veyed high priority data for identifying respective 
first means, responsive to received signal, for provid- 50 blocks of high priority data includes; 
ing said high and low priority data with header means for recovering said codeword CW#j; 
data excised, and for providing said header data; decoding means for delineating said high priority 
second means responsive to said high priority data codewords; 
and said header data from said high priority chan- means, responsive to said codeword CW#j for seg- 
nel for variable length decoding said high priority 55 menting said separated codewords into said respec- 
codewords CW to establish demarcation between tive blocks of high priority data, 
respective codewords, and to identify respective 6. The apparatus set forth in claim 4 wherein at least 
types of said codewords; a portion of said low priority data is variable length 
third means responsive to said low priority data and encoded and successive codewords are conveyed with- 
said header data from said low priority channel for 60 out delineation, and the last codeword of each respec- 
variable length decoding said low priority code- tive block is an end of block code EOB, and wherein 
words CW to establish demarcation between re- said means responsive to conveyed low priority data for 
spective codewords, and to identify respective identifying respective blocks of low priority data in- 
types of said codewords; eludes: 
fourth means, responsive to said header data, for 65 decoding means for recognizing said EOB code; and 
identifying corresponding blocks of high and low means, responsive to said EOB code for segmenting 
priority data, and providing as said single data said low priority codewords into said respective 
stream, high priority data codewords for a block blocks of low priority data. 
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7. Apparatus for combining high and low priority blocks and including said EOB code and wherein said 
video data conveyed in high and low priority data chan- second means is responsive to said number for switch- 
nels, said high and low priority data being derived from ing between providing high and low priority code- 
blocks of data, each block of data including a plurality words and is responsive to said EOB codes for switch- 
of codewords, and a portion of said plurality of code- 5 ing between providing low and high priority code- 
words from respective blocks is selected as high priority words. 

data and the remainder of said plurality of codewords of 13. In a television processing system for decoding 
respective blocks is allocated as low priority data and compressed video signal transmitted as high and low 
wherein an indicia is transmitted with said high priority priority data in high arid low priority channels respec- 
data which indicates the respective portions of respec- 10 tively, said data including codewords CW of differing 
tive blocks selected as high priority data, said apparatus types, said types representing a hierarchy of greater to 
comprising: lesser importance to image reproduction with code- 
first means responsive to said high and low priority wor( j types of greater and lesser importance being in- 
data for decoding said data and providing respec- eluded in said high and low priority channels respec- 
tive sequences of codewords of high and low prior- 15 tivc j yi ^ codewords occurring in blocks of data, with 
ity data; data from respective blocks occurring in both said high 
second means responsive to said high and low prior- ^ low priority channels, and wherein the data of said 
ity sequences of codewords and said indicia, for ^ ^ low priority channels are conveyed in respec- 
provtding a plurality of codewords of said high tivc transport packets having header data including 
priority sequence corresponding to a respective 20 block identifiers, and the header date of the high prior- 
said portion of a respective block of data and pro- ity channcl transport packets including codewords 
viding a plurality of codewords of said low pnonty cw#j idcntifying typcs of codewords included in said 
sequence through a predetermined codeword of w h chan ntl t apparatus for combining said data 
said low pnonty sequence, said plurality of code- ffom ^ hj - ^ ^ norit channcIs int0 a sing i e 
words of said low pnonty sequence ^corresponding 25 ^ 5trcam nsi 

to the remainder of said plurality of codewords of first m responsivc t0 receiveo , ignal( for provid- 

said respective block of data; and m ^ ^ ^ low ri ority data with header 

means for combining said plurali y o^^J J ^ cxci 4 md for p^ing header data; 

said low pnonty sequence with said I plurality of means/ responsive to said codewords CW#j 

codewordsof Mld t ^P^ 30 i„ said header date, for segmenting said high prior- 

8. The apparatus set forth in claim 7 wherein said * . , K1 r. - f * 

second predetermined codewords are end of block J* data mto respective partial blocks of data; 

v third means, responsive to said low pnonty data, for 

9. The apparatus set forth in claim 7 wherein said segmenting said low priority date into respective 
indicia conditions said second means to divide said se- 35 P*^ al blocks of dat * . A . . . f 
quence into portions at every jth codeword in at least a f o" rth means ' responsive to said header data for corn- 
portion of said high priority sequence of codewords. corresponding partial blocks of high and 

10. The apparatus set forth in claim 9 wherein said low pnonty data to provide reconstructed blocks 
high and low priority data are variable length coded of J** as said single date stream. 

and said first means includes variable length decoding 40 " The system set forth in claim 13 wherein said low 
means priority date provided in said low pnonty channel wi- 
ll. The apparatus set forth in claim 7 wherein said ^aes end of block codes, and said third means is re- 
high and low priority video data are conveyed in mutu- sponsive to said end of block codes for segmenting said 
ally exclusive high and low priority transport packets of low priority data into said partial blocks, 
predetermined numbers of bits including respective 45 15. The system set forth in claim 14 wherein said 
transport packet headers, said transport packet headers fourth means includes said end of block codes in the 
including information for identifying segments of the partial blocks of low prionty data combined with said 
respective high priority video data conveyed in respec- partial blocks of high priority data, 
live high priority transport packets and identifying cor- 16. The system set forth in claim 13 wherein said 
responding segments of the low priority video data 50 transport blocks include error check codes, and said 
conveyed in respective low priority transport packets, first means includes error detection circuitry, respon- 
and wherein said second means is responsive to said sive to said error check codes for generating an error 
high and low priority transport packet header informs- signal on the occurrence of transmission errors in at 
tkra for aligning corresponding segments of said high least transport blocks of low priority data, and said 
and low priority data. 55 fourth means includes means for substituting end of 
12. The apparatus set forth in. claim 7 wherein said block codes for partial blocks of low priority data from 
high and low priority video data are derived from a transport blocks for which errors are detected, 
sequence of blocks of codewords, with each block end- 17. The system set forth in claim 13 wherein said 
ing with an EOB code, said high priority video date codewords are encoded as variable length codewords, 
including a first occurring number of codewords in 60 and said second and third means include variable length 
respective blocks and is conveyed with said indicia decoding means responsive to said codewords, for es- 
indi eating said number, and said low priority video data teblishing demarcation between respective codewords, 
consists of the remaining codewords in respective * * * * * 

65 
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